Tactile Convolutional Networks for Online Slip and Rotation Detection

We present a deep convolutional neural network which is capable to distinguish between different contact states in robotic manipulation tasks. By integrating spatial and temporal tactile sensor data from a piezo-resistive sensor array through deep learning techniques, the network is not only able to classify the contact state into stable versus slipping, but also to distinguish between rotational and translation slippage. We evaluated different network layouts and reached a final classification rate of more than 97%. Using consumer class GPUs, slippage and rotation events can be detected within 10 ms, which is still feasible for adaptive grasp control.